NCR 9983 
Claims 

We claim: 

1. A method of joining a first table ti and a second table t2, each table containing rows and columns 
and being divided into one or more partitions, the method including: 
5 (a) calculating a correlation function between a first correlated value column of table ti and a 

second correlated value column of table ta; 

(b) receiving a query requesting a join between table ti and table t2; and 

(c) performing a joining algorithm, wherein the partitions containing the rows to be joined are 

determined based at least in part upon the correlation function. 

10 2. The method of claim 1, wherein (b) occurs before (a). 

The method of claim 1,. wherein the joining algorithm comprises: 

(cl) calculating, based at least in part upon the correlation function, a first number fi and a 
second number f2, wherein fi and f2 denote the number of partitions of table ti and table 
t2, respectively, to be joined; 
(c2) determining, based at least in part upon the correlation function, a first starting partition 

number Pi for table ti and a second starting partition number P2 for table t2; 
(c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 

starting at Pi; 
(c4) updating Pi and P2. 

20 4. The method of claim 3, wherein (c3) and (c4) are repeated while at least one table has at least one 
active, non-eliminated partition. 

5. The method of claim 3, wherein the fz partitions to be joined in (c3) are contiguous. 

6. The method of claim 3, wherein the fi partitions to be joined in (c3) are contiguous. 

7. The method of claim 3, wherein the f2 partitions to be joined in (c3) are not contiguous. 
25 8. The method of claim 3, wherein the fi partitions to be joined in (c3) are not contiguous. 
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9. The method of claim 3, wherein the span of the fi partitions in table ti and the span of the 
partitions in table t2 to be joined in (c3) are increased, the method further comprises: 

(c31) setting a parameter eps equal to the minimum number of inactive or eliminated partitions 
in (i) the span of fi partitions in table ti beginning at Pi and in (ii) the span of f2 
partitions of table t2 beginning at P2; 

(c32) increasing the value of f2 by eps; 

(c33) increasing the value of fi by eps; and 

(c34) after performing (c4), resetting the value of f2 equal to the value of f2 calculated in (cl) 
and resetting the value of fi equal to the value of fi calculated in (cl). 

10. The method of claim 9, wherein (c31), (c32), and (c33) are repeated if some of the partitions 
added in the preceding iteration of (c31), (c32), and (c33) are empty. 

11. The method of claim 3, wherein the span of the fi partitions in table ti and the span of the f2 
partitions in table t2 to be joined in (c3) is increased, the method further comprises: 

(c31) setting a parameter eps equal to the result of the function FL00R(x/2), wherein x is a 
sum of the number of inactive or eliminated partitions in the span of fi partitions in table 
ti beginning at Pi and the span of f2 partitions in table t2 beginning at P2, and 
FL00R(x/2) retums a largest integer that is less than or equal to x/2; 

(c32) increasing the value of f2 by eps; 

(c33) increasing the value of fi by eps; and 

(c34) after performing (c4), resetting the value of f2 equal to the value of f2 calculated in (cl) 
and resetting the value of fi equal to the value of fi calculated in (cl). 

12. The method of claim 11, wherein (c31), (c32), and (c33) are repeated if some of the partitions 
added in the preceding iteration of (c31), (c32), and (c33) are empty. 
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13. The method of claim 1, wherein calculating the correlation function includes: 

joining table ti to table t2 using PK=FK as the join condition to produce a join result having 
rows, each row including a value from cvi and a value from CV2, wherein PK denotes a 
primary key column in table ti, FK denotes a foreign key column in table t2, cvi denotes 
a first correlated value column in table ti, and cv2, denotes a second correlated value 
column in table t2; 

creating an initial running constraint (RC), the initial running constraint comprising a null 
range; and 

producing a derived constraint rule (DCR) having the following form: 

(PK = FK) CV2 + Ci < CVi < CV2 + C2, 

where C\ and C2 are constants, and means "implies;" 
by performing the following processing for each row in the join result: 
computing a new constraint (NEW), having a range; and 
modifying RC by merging the range of NEW with the range of RC. 
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14. The method of claim 13, wherein the joining algorithm comprises: 

(cl) calculating, based at least in part upon the correlation function, a first number fi and a 
second number £2, wherein fi and fa denote the number of partitions of table ti and table 
t2, respectively, to be joined, wherein: 
5 p is set equal to a size of a partition range of table ti and table ta; 

pci is set equal to the value of (SIGN(ci)*CEILING(ABS(ci)/p)), wherein 
SIGN(ci) returns a value of-1 if ci is less than zero, otherwise SIGN(ci) 
returns a value of 1, ABS(ci) returns an absolute value of Ci, and 
CEILING(ABS(ci)/p) returns a smallest integer that is not less than the 
10 value of ABS(ci)/p; 

1^ pc2 is set equal to the value of (SIGN(c2)*CEILING(ABS(c2)/p)), wherein 

P SIGN(c2) retums a value of -1 if C2 is less than zero, otherwise SIGN(c2) 

Q 

y returns a value of 1, ABS(c2) retums an absolute value of C2, and 

Q CEILING(ABS(c2)/p) retums a smallest integer that is not less than the 

145 value of ABS(c2)/p; 

g n is set equal to pC2 - pci + 1, wherem n is a number of contiguous partitions in 

^ table ti that may have rows matching rows in a single partition of table 

fU t2; 

Q m is a maximum number of file contexts; 

^0 f2 is set equal to the smallest integer value that is equal to or greater than the ' 

value of ((m-n)/2); 
fi is set equal to n + f2 -1 ; 
(c2) determining, based at least in part upon the correlation function, a first starting partition 
number Pi for table ti and a second starting partition number P2 for table t2, wherein: 
25 P2 is set equal to a lowest partition number in table t2 such that P2 is a first 

active, non-eliminated partition in table t2, and at least one of the 
partitions in the interval between P2 - pC2 and P2 - pci in table ti is an 
active, non-eliminated partition; 
Pi is set equal to P2 - pC2; 

30 (c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 

starting at Pi; 
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(c4) updating Pi and P2, wherein: 



5 



P2 is set equal to a lowest partition number in table t2, wherein: 

the lowest partition number is greater than or equal to the sum of P2 + h\ 
P* is a first active, non-eliminated partition; 

at least one of the partitions in the interval between P2 - pc2 and P2 - pci in 



table ti is an active, non-eliminated partition; and 
Pi is set equal to - PC2. 

15. The method of claim 14, wherein (c3) and (c4) are repeated while at least one table has at least one 
active, non-eliminated partition. 

Mo 16. The method of claim 1, wherein the joining algorithm includes: 



^3 



(cl) creating a file context, which stores at least location data for a row and a first value 



S 3 1 



associated with the row, for each partition of the set of partitions to be joined; 
(c2) determining the lowest first value stored by the file contexts that is equal to or greater than 



a particular hash value; and 
(c3) identifying rows with a particular first value by reading the file contexts. 
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17. A method of joining a first table ti and a second table t2, each table containing rows and columns 
and being divided into one or more partitions, the method including: 

(a) calculating a correlation function between a first correlated value column of table ti and a 
second correlated value colimin of table t2. wherein calculating the correlation fimction 

5 includes: 

joining table ti to table t2 using PK=FK as the join condition to produce a join 
result having rows, each row including a value from cvj and a value from 
CV2, wherein PK denotes a primary key column in table ti, FK denotes a 
foreign key column in table t2, cvi denotes a first correlated value 
10 column in table ti, and CV2, denotes a second correlated value column in 

table t2; 

I creating an initial running constraint (RC), the initial running constraint 

comprising a null range; 
producing a derived constraint rule (DCR) having the following form: 

^15 (PK = FK) CV2 + Ci < CVi < CV2 + C2, 

where ci and C2 are constants, and means "impUes;" 
La by performing the following processing for each row in the join result: 

p''; computing a new constraint (NEW), having a range; and 

©1 modifying RC by merging the range of NEW with the range of RC; 

Q 

1^0 setting p equal to a size of a partition range of table ti and table t2; 

determining a first correlation coefficient pci which is equal to the value of 
(SIGN(ci) * CEILING(ABS(ci)/p)), wherein SIGN(ci) retums a value of 
-1 if ci is less than zero, otherwise SIGN(ci) retums a value of 1, 
ABS(ci) retums the absolute value of ci, and CEILING(ABS(ci)/p) 
25 retums a smallest integer that is equal to or greater than ABS(ci)/p; 

determining a second correlation coefficient pc2 which is equal to the value of 
(SIGN(C2) * CEILING(ABS(c2)/p)), wherein SIGN(c2) retums a value of 
-1 if C2 is less than zero, otherwise SIGN(C2) retums a value of 1, 
ABS(C2) retums the absolute value of C2, and CEILING(ABS(c2)/p) 
30 retums a smallest integer that is equal to or greater than ABS(c2)/p; 

(b) receiving a query requesting a join between table ti and table t2; 
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(c) calculating a first number fi and a second number f2, wherein fi and fa denote the number of 

partitions of table ti and table t2, respectively, to be joined, wherein calculating fi and {2 
include: 

setting n equal to pc2 - pci + 1 ; 

determining a parameter m, which is a maximum number of file contexts; 
setting f2 equal to the smallest integer value that is equal to or greater than the 

value of ((m-n)/2); and 
setting fi equal to n + fa -1 ; 

(d) determining a first starting partition number Pi for table ti and a second starting partition 

number P2 for table t2, wherein Pi and P2 are calculated by; 

^ setting P2 equal to a lowest partition number in ta such that P2 is a first active, 
non-eliminated partition in table t2, and at least one of the partitions in 
the interval between P2 - pc2 and P2 - pci in table ti is an active, non- 
eliminated partition; and 
setting Pi equal to P2 - pca; 

(e) performing a joining algorithm, wherein a set of £2 partitions of table t2 starting at P2 are 

joined with a set of fi partitions of table ti starting at Pi, wherein the joining algorithm 
includes: 

creating a file context, which stores at least location data for a row and a first 
value associated with the row, for each partition of the set of partitions to 
be joined; 

determining the lowest first value stored by the file contexts that is equal to or 

greater than a particular hash value; and 
identifying rows with a particular first value by reading the file contexts; 

(f) updating Pi and P2, wherein the updating Pi and P2 includes: 

finding a lowest partition number Pj* ^2 that is greater than or equal to the sum 
of P2 + f2 such that Pj* is a first active, non-eliminated partition, and at 
least one of the partitions in the interval between - PC2 and P2 - pci 
in table ti is an active, non-eliminated partition; 

setting P2 equal to Pj* \ 

setting Pi equal to - pc2; and 
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(g) repeating steps (e)-(f) while at least one table has at least one active, non-eliminated 
partition. 

18. A computer program, stored in tangible medium, for joining a first table ti and a second table ta, 
each table containing rows and columns and being divided into one or more partitions, the program 

5 comprising executing instructions that cause a computer to: 

(a) calculate a correlation function between a first correlated value column of table ti and a 

second correlated value column of table t2\ 

(b) receive a query requesting a join between table ti and table t2; and 

(c) perform a joining algorithm, wherein the partitions containing the rows to be joined are 
10 determined based at least in part upon the correlation function. 

19. The computer program of claim 18, wherein (b) occurs before (a). 

20. The computer program of claim 18, wherein the joining algorithm comprises: 
(cl) calculating, based at least in part upon the correlation function, a first number fi and a 

second number f2, wherein fi and denote the number of partitions of table ti and table 
t2, respectively, to be joined; 
(c2) determining, based at least in part upon the correlation function, a first starting partition 

number Pi for table ti and a second starting partition number P2 for table t2; 
(c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 

starting at Pi; 
(c4) updating Pi and P2. 

21. The computer program of claim 20, wherein (c3) and (c4) are repeated while at least one table has 
at least one active, non-eliminated partition. 

22. The computer program of claim 20, wherein the f2 partitions to be joined in (c3) are contiguous, 

23. The computer program of claim 20, wherein the fi partitions to be joined in (c3) are contiguous. 
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24. The computer program of claim 20, wherein the f2 partitions to be joined in (c3) are not 
contiguous. 

25. The computer program of claim 20, wherein the fi partitions to be joined in (c3) are not 
contiguous. 

26. The computer program of claim 20, wherein the span of the fi partitions in table ti and the span of 
the fi partitions in table ta to be joined in (c3) are increased, further comprising: 

(c31) setting a parameter eps equal to the minimiun number of inactive or eliminated partitions 
in (i) the span of fi partitions in table ti beginning at Pi and in (ii) the span of f2 
partitions of table ti beginning at P2; 

(c32) increasing the value of f2 by eps; 

(c33) increasing the value of ft by eps; and 

(c34) after performing (c4), resetting the value of f2 equal to the value of f2 calculated in (cl) 
and resetting the value of fi equal to the value of fi calculated in (cl). 

27. The computer program of claim 26, wherein (c31), (c32), and (c33) are repeated if some of the 
partitions added in the preceding iteration of (c31), (c32), and (c33) are empty. 

28. The computer program of claim 20, wherein the span of the fi partitions in table ti and the span of 
the f2 partitions in table t2 to be joined in c3 is increased, the computer program further comprises: 

(c31) setting a parameter eps equal to the result of the function FL00R(x/2), wherein x is a 
sum of the number of inactive or eliminated partitions in the span of fi partitions in table 
ti beginning at Pi and the span of f2 partitions in table t2 beginning at P2, and 
FL00R(x/2) returns a largest integer that is less than or equal to x/2; 

(c32) increasing the value of f2 by eps; 

(c33) increasing the value of ft by eps; and 

(c34) after performing (c4), resetting the value of f2 equal to the value of f2 calculated in (cl) 
and resetting the value of ft equal to the value of ft calculated in (cl). 
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29. The computer program of claim 28, wherein (c31), (c32), and (c33) are repeated if some of the 
partitions added in the preceding iteration of (c31), (c32), and (c33) are empty. 

30. The computer program of claim 18, wherein calculating the correlation function includes: 

joining table ti to table t2 using PK=FK as the join condition to produce a join result having 
rows, each row including a value from cvi and a value from CV2, wherein PK denotes a 
primary key column in table ti, FK denotes a foreign key column in table t2, cvi denotes 
a first correlated value column in table ti, and cv2, denotes a second correlated value 
column in table t2; 

creating an initial running constraint (RC), the initial running constraint comprising a null 
range; and 

producing a derived constraint rule (DCR) having the following form: 

(PK = FK) CV2 + Ci < CVi < CV2 + C2, 

where Ci and C2 are constants, and means "implies;" 
by performing the following processing for each row in the join result: 
computing a new constraint (NEW), having a range; and 
modifying RC by merging the range of NEW with the range of RC. 
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31. The computer program of claim 30, wherein the joining algorithm comprises: 

(cl) calculating, based at least in part upon the correlation function, a first munber fi and a 
second number f2, wherein fi and f2 denote the number of partitions of table ti and table 
t2, respectively, to be joined, wherein: 



p is set equal to a size of a partition range of table ti and table t2; 

pci is set equal to the value of (SIGN(ci)*CEILING(ABS(ci)/p)), wherein 
SIGN(ci) returns a value of-1 if ci is less than zero, otherwise SIGN(ci) 
returns a value of 1, ABS(ci) retums an absolute value of Ci, and 
CEILING(ABS(ci)/p) retums a smallest integer that is not less than the 
value of ABS(ci)/p; 

pc2 is set equal to the value of (SIGN(c2)*CEILING(ABS(c2)/p)), wherein 
SIGN(C2) retums a value of -1 if C2 is less than zero, otherwise SIGN(c2) 
retums a value of 1, ABS(C2) retums an absolute value of C2, and 
CEILING(ABS(c2)/p) retums a smallest integer that is not less than the 
value of ABS(c2)/p; 

n is set equal to pC2 - pci + 1, wherein n is a number of contiguous partitions in 
table ti that may have rows matching rows in a single partition of table 



m is a maximum number of file contexts; 

f2 is set equal to the smallest integer value that is equal to or greater than the . 

value of ((m-n)/2); 
fi is set equal to n + f2 -1 ; 



(c2) determining, based at least in part upon the correlation function, a first starting partition 
number Pi for table ti and a second starting partition number Pa for table t2, wherein: 



P2 is set equal to a lowest partition number in table t2 such that P2 is a first 
active, non-eliminated partition in table t2, and at least one of the 
partitions in the interval between P2 - pc2 and P2 - pci in table ti is an 
active, non-eliminated partition; 

Pi is set equal to P2 - pC2; 



(c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 
starting at Pi; 
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(c4) updating Pi and P2, wherein: 

P2 is set equal to a lowest partition number in table t2, wherein: 

the lowest partition number is greater than or equal to the sum of P2 + fi\ 
P* is a first active, non-eliminated partition; 

at least one of the partitions in the interval between P* - pca and P^ - pci in 
table ti is an active, non-eHminated partition; and 
Pi is set equal to P^ - pc2. 

32. The computer program of claim 31, wherein (c3) and (c4) are repeated while at least one table has 
at least one active, non-eliminated partition. 

33. The computer program of claim 18, wherein the joining algorithm includes: 

(cl) creating a file context, which stores at least location data for a row and a first value 
associated with the row, for each partition of the set of partitions to be joined; 

(c2) determifiing the lowest first value stored by the file contexts that is equal to or greater than 
a particular hash value; and 

(c3) identifying rows with a particular first value by reading the file contexts. 
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34. A system in which a first table ti is joined with a second table tz, each table containing rows and 
columns and being divided into one or more partitions, comprising: 

a massively parallel processing system comprising: 

one or more nodes; 

5 a plurality of CPUs, each of the one or more nodes providing access to one or more CPUs; 

a plurality of processes each of the one or more CPUs providing access to one or more virtual 
processes; 

each process configured to manage data, including the partitioned database table, stored in one 
of a plurality of data-storage faciUties; 
10 a partitioned table access component configured to select rows fi-om the table by: 

(a) calculating correlation function between a first correlated value column of table ti 
and a second correlated value colunm of table tr, 

Q 

p (b) receiving a query requesting a join between table ti and table t2; and 

^ (c) performing a joining algorithm, wherein the partitions containing the rows to be 

Ql5 joined are determined based at least in part upon the correlation function. 

5 

^ 35, The system of claim 34, wherein (b) occurs before (a). 

nj 36. The system of claim 34, wherein the joining algorithm comprises: 

m (cl) calculating, based at least in part upon the correlation function, a first number fi and a 

^ second number f2, wherein fi and f2 denote the number of partitions of table ti and table 

20 t2, respectively, to be joined; 

(c2) determining, based at least in part upon the correlation function, a first starting partition 

number Pi for table ti and a second starting partition number P2 for table t2; 
(c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 
starting at Pi; 
25 (c4) updating Pi and P2. 
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37. The system of claim 36, wherein (c3) and (c4) are repeated while at least one table has at least one 
active, non-eliminated partition. 

38. The system of claim 36, wherein the f2 partitions to be joined in (c3) are contiguous. 

39. The system of claim 36, wherein the fi partitions to be joined in (c3) are contiguous. 

40. The system of claim 36, wherein the fa partitions to be joined in (c3) are not contiguous. 

41. The system of claim 36, wherein the fi partitions to be joined in (c3) are not contiguous. 

42. The system of claim 36, wherein the span of the fi partitions in table ti and the span of the fa 
partitions in table ta to be joined in (c3) are increased, further comprising: 

(c3 1) setting a parameter eps equal to the minimum number of inactive or eliminated partitions 
in (i) the span of fi partitions in table ti beginning at Pi and in (ii) the span of fa 
partitions of table ta beginning at Pa; 

(c32) increasing the value of fa by eps; 

(c33) increasing the value of fi by eps; and 

(c34) after performing (c4), resetting the value of fa equal to the value of fa calculated in (cl) 
and resetting the value of fi equal to the value of fi calculated in (cl). 

43. The system of claim 42, wherein (c31), (c32), and (c33) are repeated if some of the partitions 
added in the preceding iteration of (c31), (c32), and (c33) are empty. 

44. The system of claim 36, wherein the span of the fi partitions in table ti and the span of the fa 
partitions in table ta to be joined in c3 is increased, the system further comprises: 

(c31) setting a parameter eps equal to the result of the function FL00R(x/2), wherein x is a 
simi of the number of inactive or eliminated partitions in the span of fi partitions in table 
ti beginning at Pi and the span of fa partitions in table ta beginning at Pa, and 
FL00R(x/2) retums a largest integer that is less than or equal to x/2; 

(c32) increasing the value of fa by eps; 

(c33) increasing the value of fi by eps; and 

(c34) afler performing (c4), resetting the value of fa equal to the value of fa calculated in (cl) 
and resetting the value of fi equal to the value of fi calculated in (cl). 
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45. The system of claim 44, wherein (c31), (c32), and (c33) are repeated if some of the partitions 
added in the preceding iteration of (c31), (c32), and (c33) are empty. 

46. The system of claim 34, wherein calculating the correlation function includes: 

joining table ti to table t2 using PK=FK as the join condition to produce a join result having 
rows, each row including a value from cvi and a value from CV2, wherein PK denotes a 
primary key column in table ti, FK denotes a foreign key column in table t2, cvi denotes 
a first correlated value column in table ti, and cv2, denotes a second correlated value 
column in table t2; 

creating an initial running constraint (RC), the initial running constraint comprising a null 
range; and 

producing a derived constraint rule (DCR) having the following form: 

(PK = FK) CV2 + Ci < CVi < CV2 + C2, 

where ci and C2 are constants, and means "implies;" 
by performing the following processing for each row in the join resuU: 
computing a new constraint (NEW), having a range; and 
modifying RC by merging the range of NEW with the range of RC. 
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47. The system of claim 46, wherein the joining algorithm comprises: 

(cl) calculating, based at least in part upon the correlation function, a first number fi and a 
second number f2, wherein fi and fz denote the number of partitions of table ti and table 
t2, respectively, to be joined, wherein: 

p is set equal to a size of a partition range of table ti and table ti; 
pci is set equal to the value of (SIGN(ci)*CEILING(ABS(ci)/p)), wherein 
SIGN(ci) retums a value of -1 if Ci is less than zero, otherwise SIGN(ci) 
returns a value of 1, ABS(ci) retums an absolute value of Ci, and 
CEILING(ABS(ci)/p) retums a smallest integer that is not less than the 
value of ABS(ci)/p; 

pc2 is set equal to the value of (SIGN(c2)*CEILING(ABS(c2)/p)), wherein 
SIGN(c2) retums a value of -1 if ca is less than zero, otherwise SIGN(c2) 
retums a value of 1, ABS(c2) retums an absolute value of C2, and 
CEILING(ABS(c2)/p) retums a smallest integer that is not less than the 
value of ABS(c2)/p; 

n is set equal to pC2 - pci + 1, wherein n is a number of contiguous partitions in 
table ti that may have rows matching rows in a single partition of table 
t2; 

m is a maximum number of file contexts; 

f2 is set equal to the smallest integer value that is equal to or greater than the 

value of ((m-n)/2); 
fi is set equal to n + f2 -1 ; 
(c2) determining, based at least in part upon the correlation function, a first starting partition 
number Pi for table ti and a second starting partition nimiber P2 for table t2, wherein: 

P2 is set equal to a lowest partition nimiber in table t2 such that P2 is a first 
active, non-eliminated partition in table t2, and at least one of the 
partitions in the interval between P2 - pc2 and P2 - pcj in table ti is an 
active, non-eliminated partition; 
Pi is set equal to P2 - pc2; 
(c3) joining a set of f2 partitions of table t2 starting at P2 with a set of fi partitions of table ti 
starting at Pi; 
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(c4) Updating Pi and P2, wherein: 

P2 is set equal to a lowest partition number in table t2, wherein: 

the lowest partition number is greater than or equal to the sum of P2 + h\ 
P2 is a first active, non-eliminated partition; 

at least one of the partitions in the interval between P2 - pc2 and P2 - pci in 
table ti is an active, non-eliminated partition; and 
Pi is set equal to P2 - pC2. 

48. The system of claim 47, wherein (c3) and (c4) are repeated while at least one table has at least one 
active, non-eliminated partition. 

49. The system of claim 34, wherein the joining algorithm includes: 

(cl) creating a file context, which stores at least location data for a row and a first value 
associated with the row, for each partition of the set of partitions to be joined; 

(c2) determining the lowest first value stored by the file contexts that is equal to or greater than 
a particular hash value; and 

(c3) identifying rows with a particular first value by reading the file contexts. 
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